A Deep Metric for Multimodal Registration
نویسندگان
چکیده
Multimodal registration is a challenging problem due the high variability of tissue appearance under different imaging modalities. The crucial component here is the choice of the right similarity measure. We make a step towards a general learning-based solution that can be adapted to specific situations and present a metric based on a convolutional neural network. Our network can be trained from scratch even from a few aligned image pairs. The metric is validated on intersubject deformable registration on a dataset different from the one used for training, demonstrating good generalization. In this task, we outperform mutual information by a significant margin.
منابع مشابه
Hierarchical segmentation-assisted multimodal registration for MR brain images
Information theory-based metric such as mutual information (MI) is widely used as similarity measurement for multimodal registration. Nevertheless, this metric may lead to matching ambiguity for non-rigid registration. Moreover, maximization of MI alone does not necessarily produce an optimal solution. In this paper, we propose a segmentation-assisted similarity metric based on point-wise mutua...
متن کاملDeformable multimodal registration with gradient orientation based on structure tensors
Deformable registration of images obtained from different modalities remains a challenging task in medical image analysis. This paper addresses this problem and proposes a new similarity metric for multi-modal registration. The metric is based on the orientation of image gradients. In contrast to earlier work, our metric is based on the structure tensor of the spatial image gradients and can ro...
متن کاملECSE 626 Project Report Multimodality Image Registration by Maximization of Mutual Information
In 1997, Maes et al. [5] was one of the first papers to propose mutual information as a similarity metric for performing multimodal image registration. More than ten years later, mutual information is now found at the core of many state-of-the-art image registration algorithms [2]. The aim of this project is to demonstrate its simplicity, accuracy, and robustness, by implementing the original a...
متن کاملA new hybrid particle swarm optimization for mutlimodal brain image registration
Image registration is an important issue in medical analysis. In this process the spatial transformation that aligns the reference image and the floating image is estimated by optimizing a similarity metric. Mutual information (MI), a popular similarity metric, is a reliable criterion for medical image registration. In this paper, we present an improved method for multimodal image registration ...
متن کاملOptimized co-registration method of Spinal cord MR Neuroimaging data analysis and application for generating multi-parameter maps
Introduction: The purpose of multimodal and co-registration In MR Neuroimaging is to fuse two or more sets images (T1, T2, fMRI, DTI, pMRI, …) for combining the different information into a composite correlated data set in order to visualization, re-alignment and generating transform to functional Matrix. Multimodal registration and motion correction in spinal cord MR Neuroimag...
متن کامل